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Abstract. The quest for optimal/stable paths in graphs has gained at- 
tention in a few practical or theoretical areas. To take part in this quest 
this chapter adopts an equilibrium-oriented approach that is abstract 
and general: it works with (quasi-arbitrary) arc-labelled digraphs, and 
it assumes very little about the structure of the sought paths and the 
definition of equilibrium, i.e. optimality/stability. In this setting, this 
chapter presents a sufficient condition for equilibrium existence for every 
graph; it also presents a necessary condition for equilibrium existence for 
every graph. The necessary condition does not imply the sufficient condi- 
tion a priori. However, the chapter pinpoints their logical difference and 
thus identifies what work remains to be done. Moreover, the necessary 
and the sufficient conditions coincide when the definition of optimality 
relates to a total order, which provides a full-equivalence property. These 
results are applied to network routing. 



1 Introduction 

This chapter provides an abstract formalism that enables generic proofs, yet 
accurate results, about path equilibria in graphs. For other approaches to opti- 
misation in graphs see [3], for instance. Beyond this, the purpose of this chapter 
is to provide a tool for a generalisation of sequential (tree-) games within graphs. 
However, these game-theoretic facets are not discussed in this chapter. In addi- 
tion to the game-theoretic application, the results presented in this chapter may 
help solve problems of optimisation/stability of paths in graphs: a short example 
is presented for the problem of network routing . 

1.1 Contribution 

This chapter introduces the terminology of dalographs which refers to finite, arc- 
labelled, directed graphs with non-zero outdegree, i.e. each of whose node has 
an outgoing arc. An embedding of arc-labelled digraphs into dalographs shows 
that the non-zero-outdegree constraint may not yield a serious loss of generality. 
The paths that are considered in this chapter are infinite. Indeed, finite paths 
and infinite paths are of slightly different " types" . Considering both may hinder 
an algebraic approach of the system. However, another embedding allows repre- 
senting finite paths in a dalograph as infinite paths in another dalograph. This 
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shows that the infiniteness constraint may not yield a serious loss of generality 
either. Note that the non-zero-outdegree constraint ensures existence of infinite 
paths, starting from any node. This uniformity facilitates an algebraic approach 
of the system. The paths considered in this chapter are non-self-crossing, which 
somehow suggests consistency. This sounds desirable in many areas, but it may 
be an actual restriction in some others. 

In this formalism, a path induces an ultimately periodic sequence of labels (of 
arcs that are involved in the path) . An arbitrary binary relation over ultimately 
periodic sequences of labels is assumed and named preference. This induces a 
binary relation over paths, which is also named preference. It is defined as follows. 
Given two paths starting from the same node, one is preferred over the other if 
the sequence of labels that is induced by the former is preferred over the sequence 
of labels that is induced by the latter. Maximality of a given path in a graph 
means that no path is preferred over the given path. A strategy is an object 
built over a dalograph. It amounts to every node choosing an outgoing arc. This 
way, a strategy induces paths starting from any given node. An equilibrium is a 
strategy inducing optimal paths for any node. 

The proof of equilibrium existence is structured as follows. First, a seeking- 
forward function is defined so that given a node it returns a path. Given a node, 
the function chooses a path that is maximal (according to the definition of the 
previous paragraph), and the function "follows" the path until the remaining 
path is not maximal (among the paths starting from the current node). In this 
case, the function chooses a maximal path starting from the current node and 
proceeds as before. All of this is done under the constraint that a path is non-self- 
crossing. Under some conditions, this procedure yields a path that is maximal 
not only at its starting node, but also at all nodes along the path. Such a path is 
called a hereditary maximal path. Equipped with this lemma, the existence of an 
equilibrium for every dalograph is proved as follows by induction on the number 
of arcs in the dalograph. 

— Compute a hereditary maximal path in the dalograph. 

— Remove the arcs of the dalograph that the path ignored while visiting adja- 
cent nodes and get a smaller dalograph. 

— Compute an equilibrium on this smaller dalograph and add the ignored arcs 
back. This yields an equilibrium for the original dalograph. 

The sufficient condition for equilibrium existence involves a notion lying be- 
tween strict partial order and strict total order, namely strict weak order, which 
is discussed in [I], for instance. This chapter requires a few preliminary results 
about strict weak orders. Moreover, the definition of the seeking-forward function 
requires the design of a recursion principle that is also used as a proof principle 
in this chapter. To show the usefulness of this sufficient condition, this chapter 
provides a few examples of non-trivial relations that meet the requirements of 
this condition: lexicographic extension of a strict weak order, Pareto-like order, 
and two limit-set-oriented orders. Then, as an application to network routing, 
one derives a sufficient condition for a routing policy to guarantee existence of 
stable routing solutions. 
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The proof of the necessary condition for equihbrium existence involves var- 
ious closures of binary relations. Most of the closures defined here are related 
to properties that are part of the sufficient condition. For instance, the suffi- 
cient condition involves transitivity of some preference (binary relation), and 
the necessary condition involves the transitive closure of the preference. Each 
of those various closures is proved to preserve existence of equilibrium. More 
specifically, if a preference ensures existence of equilibrium for every dalograph, 
then the closure of the preference also ensures existence of equilibrium for ev- 
ery dalograph. A new closure is defined subsequently as the combination of all 
the above-mentioned closures. Thanks to a preliminary development introducing 
the notion of simple closure, this combination closure also preserves existence 
of equilibrium. Since the combination closure has a few properties, this gives a 
non-trivial necessary condition for equilibrium existence. All the closures men- 
tioned above are defined inductively through inference rules, which allows using 
rule induction as a proof principle. To show the usefulness of this necessary con- 
dition, this chapter provides an example of a non-trivial relation that does not 
meet the requirements of this condition. 

However, not all the properties that are part of the sufhcient condition can 
be easily turned into a simple closure preserving equilibrium existence (and 
hereby be part of the necessary condition). Therefore, the necessary condition 
and sufhcient condition do not look exactly the same. Some examples show that 
the necessary condition is too weak. Some more work, i.e. the design of more 
general simple closures, is likely to take care of those examples, and hereby 
provide a stronger necessary condition. However, there is also likely to be more 
complex examples that would require the design of more complex simple closures. 
As to the sufficient condition, it is still unclear whether or not it is too strong. 

In the case where the preference is a total order, the sufficient and necessary 
conditions coincide. This gives a necessary and sufhcient condition (on a total 
order preference) for existence of equilibrium in every dalograph. This leads to 
a necessary and sufficient condition (on a total order preference) for equilibrium 
existence in the network routing application mentioned above. 

1.2 Contents 

Section [2] defines a graph-like structure named dalograph and the notion of 
equilibrium in dalographs. Section [3] defines a refinement of partial order that is 
named strict weak order in the literature. This section also connects the notion 
of strict weak order to other properties of binary relations. Section 2] proves a 
sufficient condition that guarantees existence of equilibrium for all dalographs. 
It also gives a few examples of non-trivial relations meeting the requirements 
of the sufficient condition. Finally, it gives an application in network routing. 
Section [5] defines the notion of simple closure and proves a property about the 
union of simple closures. Section[5]discusses preservation of equilibrium existence 
by closures, and thus provides a necessary condition for existence of equilibrium 
for all dalographs. Section [7| compares the sufhcient condition and the necessary 
condition, and shows that they coincide in the total order case but not in general. 
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It also describes a relation that does not meet the requirements of the necessary 
condition. Finally, it gives a necessary and sufficient condition, in the total order 
case, for equilibrium existence in the network routing application mentioned 
above. 

1.3 Conventions 

Unless otherwise stated, universal quantifiers are usually omitted in front of 
(semi-) formal statements. For instance, a claim of the form P{x, y) should be 
read Vcc, y, P{x, y). 

Usually, when proving a claim of type tq => • • • => t„_i t„ t, the 
beginning of the proof implicitly assumes tq,..., t„_i , and r„, and then starts 
proving r. 

Given u a non-empty finite sequence, (resp. u') represents the first (resp. 
last) element of u. 

The notation P{x) = Q{x) means that P is defined as coinciding with Q. 
The negation of a relation -< is written as follows. 

a 7< /3 = -(a /3) 
The corresponding incomparability relation is defined below. 

The inverse of a relation ~< is defined as follows. 

a >- (i = (i < a 
Restrictions of binary relations are written as follows. 

a -<|s /3 = a< (3 ^ {a,(3) e 

Function composition is defined as (almost) usual. For any functions /i of 
type A B and /2 of type B ~> C, the composition of /i and /2 is written 
/2 ° /i- It is of type A ^ C and it is defined as follows. 

f2 0hix) ^ f2{h{x)) 

In this chapter, /i o /2 may be written /1/2, in the same order. 
2 Dalographs and Equilibria 

Subsection 12.11 defines a class of arc-labelled digraphs, subsection 12.21 defines a 
class of paths in such arc-labelled digraphs, and subsection l2.3l derives a notion of 
equilibrium from a notion of maximality for paths. The more general will be those 
graphs and paths, the more general will be the derived notion of equilibrium. 
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2.1 Dalographs 



This subsection gives a name to the class of arc-labelled directed graphs each 
of whose node has at least one outgoing arc. Then it briefly justifies why arc 
labelling is "more general" than node labelling, and why the non-zero-outdegree 
constraint may not yield a serious loss of generality. 

Definition 1 (Dalograph) Let L be a collection of labels. A dalograph is a 
finite directed graph whose arcs are labelled with elements of L, and such that 
every node has a non-zero outdegree. 

The picture below is an example of dalograph, with 5 labels from ai to 05. 
Squares represent nodes, but they may not be displayed in every further example. 



as 



ai 



a4 



as 



One may argue that labelling the arcs leave out the node-labelled digraphs, 
as the example below. 
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However, there is a natural way of embedding node-labelled digraphs into 
arc-labelled digraphs: for each node, remove the label from the node and put it 
on all the outgoing arcs of the node. The picture below shows the above example 
being translated into dalographs. 



^a2^ \y «6 / / 



0^ 



a5 



Due to the embedding, arc labelling appears to be more general than node 
labelling. 

Demanding that all nodes have non-zero outdegree may not yield a serious 
loss of generality cither. Indeed there is also an embedding from arc-labelled di- 
graphs into dalographs, using a dummy node and a dummy label dl. For example, 
this embedding maps the left-hand graph below to the right-hand dalograph. 
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2.2 Walks and Paths 

This subsection defines a walk in a dalograph as a finite sequence of nodes that 
goes continuously along the arcs of the dalograph. In addition, a walk must stop 
when intersecting itself. A looping walk is defined as a walk intersecting itself. 
This enables the definition of an alternative induction principle along walks. 
Then, paths are defined as infinite sequences that are consistent with looping 
walks, and this definition is briefly justified. 

Definition 2 (Walks as sequence of nodes) Walks in a digraph are defined 

by induction as follows. 

— e is the empty walk. 

— o is a walk for any node o of the dalograph. 

— If oq . . .On is a walk, if o does not occur in oq, . . . ,On-i, and if ooq is an arc 
of the dalograph, ooq . . .On is also a walk. 

If a node occurs twice in a walk, then it occurs at the end of the walk. In this 
case, the walk is said to he looping. 

The first picture below shows the walk 01O2O3 using double lines. The second 
picture shows the looping walk 01020302- 



^4 as a'e 
\ d \ / 

a4 as ae 
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It will often be convenient to represent walks partially. A (possibly empty) 
non-looping walk is represented by a double-headed arrow that is labelled with 
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a sequence of nodes. For instance, the left-hand walk u = ui . . . m„ below is 
represented by the right-hand picture. 









> 


Un 



A looping walk is represented by a squared-bracket-headed arrow that is la- 
belled with a sequence of nodes. For instance below, the left-hand looping walk 
UOVO is represented by the right-hand picture. 

n 

U — ^ 1^ „ UOVO 



A usual induction principal for walks would go from the empty walk to bigger 
walks. Here, walks take place in finite dalographs so they are bounded. This 
allows an alternative induction principle for walks. 

Lemma 3 (Nibbling induction principle for walks) Let g be a dalograph. 

Let P be a predicate on walks in g. Assume that given any walk x, P{xo) for all 
walks xo implies P{x). Then the predicate holds for all walks. 

Proof First, P holds for all looping walks since, by definition, x being a 
looping walk implies xo is not a walk. Second, assume that there exist walks 
that do not satisfy P. Let x be one such walk. By finiteness of g, it makes sense 
to take X as long as possible. So all walks xo satisfy P by definition of x, therefore 
X satisfies P by assumption. This is a contradiction. □ 

This lemma can be used as a proof principle or, quite similarly, as a pro- 
gramming principle. Indeed, let / be a function on walks. If the definition of / 
on any input x invokes only results of the computation of / with the walks xo, 
then / is well-defined a priori. 

Paths are defined as consistent infinite continuations of looping walks. 

Definition 4 (Paths as looping walks) Given a looping walk novo, the cor- 
responding path is the infinite sequence u{ov)'^ . Given a walk x and a path P 
such that xP is also a path, P is called a continuation of the walk x. 

Informally, a path has a memory, and when visiting a node for the second 
time and more, it chooses the same next node as for the first time. The formalism 
ensures the following properties. 

Lemma 5 Every walk has a continuation and a looping walk uovo has a unique 
continuation (vo)'^ . 
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If one wishes to deal with "finite paths", i.e. non- looping walks, within the 
dalograph formalism, it is possible to add a dummy node and dummy arcs from 
all original nodes to the dummy one, as shown below. 




Through the embedding above, the left-hand infinite path below may be in- 
terpreted as the right-hand finite path. 




dl dl dl 




2.3 Equilibria 

This subsection compares paths by comparing infinite sequences of labels. It 
defines strategies as dalographs having chosen an outgoing arc for each of their 
nodes, and it defines equilibria as strategies inducing maximal paths everywhere. 

Below, finite sequences of labels induced by walks are defined by induction 
(the usual induction principle, not the nibbling one) . Subsequently, paths induce 
infinite sequences of labels. 

Definition 6 (Induced sequence) Induced sequences are inductively defined 
as follows. 

— A walk o induces the empty sequence. 

— A walk 01O2X induces the sequence a.seq{o2x) where a is the label on the arc 
01O2. 

A path corresponding to a looping walk novo induces a sequence seq{uo)seq{ovo)'^ . 
A sequence that is induced by a path starting from a given node is said eligible 
at this node. 

The ultimately periodic sequences over labels are comparable through an 

arbitrary binary relation. 

Definition 7 (Preference) A relation over the ultimately periodic sequences 
over labels is called a preference. Preferences are written -< in this chapter. 
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Comparing the induced sequences of two paths starting from the same node 
is a natural way of comparing paths. 

Definition 8 (Paths comparison) If paths A and /2 start from the same 

node and induce sequences 71 and 72 with 71 -< 72 (resp. 71 7^ 72^, one writes 
r'l ^ /2 ( resp. Fi 7^ 72 j by abuse of notation. 

The following definition captures the notion of maximality (with respect to 
a preference) of a path among the continuations of a given walk. 

Definition 9 (Maximal continuation) The notation mg^^{xo,r) accounts 
for the property: xoF is a path in g and oF 7^ oF' for all paths xoF' of the 
dalograph g. 

One may write m.{xo, F) instead of mg^^{xo, F) when there is no ambiguity. 
In addition to a path being maximal from the point of view of its starting node, 
this chapter needs to discuss paths all of whose subpaths are maximal from their 
starting points. The notion of hereditary maximality captures this idea below. 

Definition 10 (Hereditary maximal path) Let F be a path. If mg^^{o,F') 

for any decomposition F = xoF' where xo is a non-looping walk, one writes 
hm,g^^{F). 

A strategy is an object built on a dalograph by choosing an outgoing arc at 
each node. 

Definition 11 (Strategy) Given a dalograph g, a strategy s on g is a pair 
{g,c), where c is a function from the nodes of g to themselves, and such that for 
all nodes a, the pair (o, c(o)) is an arc of g. 

The two examples below show two strategies with the same underlying dalo- 
graph. The choices are represented by double lines. 



As seen in the pictures above, given a strategy and a node, the strategy 
induces exactly one path starting from this node. 
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Definition 12 (Induced continuation) Let s be a strategy. Define p{s,o) 

such that o ■ p{s, o) is the path induced by s starting from o. 



Given a dalograph and a preference, a strategy on the dalograph is a local 
equilibrium at a given node if it induces a hereditary maximal path at this node. 

Definition 13 (Local equilibrium) LEq^{s,o) = mg^^{o,p{s,o)) 

A global equilibrium for a dalograph is intended to be a strategy inducing a 
maximal path at every node of the dalograph. It follows that a global equilibrium 
can be defined as a strategy that is a local equilibrium for every node of the 
dalograph. 

Definition 14 (Global equilibrium) GEq^{s) = \/o ^ g, LEq^{s,o) 

In the rest of this chapter, the terminology of equilibrium refers to global 
equilibria, unless otherwise stated, or ^-equilibrium to avoid ambiguity. In the 
example below, arcs are labelled with natural numbers and -< is the lexico- 
graphic extension of the usual order to infinite sequences of natural numbers. 
The following strategy is a local equilibrium for node o' but not for node o. 



If a preference is a subrelation of another preference, and if a given strategy is 

a local/global equilibrium with respect to the bigger preference, then the strategy 
is also a local/global equilibrium with respect to the smaller preference. This is 
formally stated below. 

Lemma 15 (Equilibrium for subpreference) Preservation by subrelation 
is stated as follows. 




-<C-<'=> LEq^>{s,o) LEq^{s,o) 



^C-<'^ GEq^,{s,o) ^ GEq^{s,o) 

Proof Note that the following formula holds. 
-<C-<'=> mg^^'{xo,r) => mg^^{xo,r). 



□ 
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Assume that two preferences coincide on a subdomain, i.e. a subset of the 
ultimately periodic sequences over labels. Assume that a given dalograph involves 
only sequences from this subdomain, i.e. all paths in the dalograph induce only 
sequences in the subdomain. In this local/global equilibrium for this 

dalograph with respect to one preference is also a local/global equilibrium for 
this dalograph with respect to other preference. As for the lemma above, this 
can be proved by simple unfolding of the definitions. This result is stated below. 

Lemma 16 Let g he a dalograph involving sequences in S only. Assume that 
-< Is Is. In this case, 

LEq^{s,o) <^ LEq^i(s,o) 

GEq^is) ^ GEq^,{s) 

The following lemma relates to the fact that when there is only one choice, 
this choice is the best possible one. 

Lemma 17 If ^ is an irreflexive preference, then a dalograph each of whose 
node has outdegree 1 has a -<- equilibrium. 

Proof In such a case, only one strategy corresponds to that dalograph and 
there is only one possible path starting from any node. Therefore, each path is 
maximal, by irreflexivity, and this strategy is an equilibrium. □ 

3 Binary Relations 

This section defines a few predicates on binary relations. Some properties con- 
necting these predicates are also presented. Subsection 13.11 deals with binary 
relations in general, while subsection 13.21 focuses on binary relations over se- 
quences. 

3.1 General Binary Relations 

This subsection slightly rephrases the notion of strict weak order, which already 
exists in the literature. This subsection also defines the notion of imitation. It 
turns out that strict weak orders can be equivalently characterised by a few other 
simple formulae. The structure of such relations is studied in detail. 

The notions of transitive, asymmetric, and irreflexive binary relation that are 
used in this chapter are the usual ones. 

Definition 18 (Transitivity, asymmetry and irreflexivity) A binary re- 
lation -< is transitive if it complies with the first formula below. Asymmetry 
amounts to the second formula, and irreflexivity to the third one. 



a < (i ^ (i yk, a 
a -/^ a 



transitivity 
asymmetry 
irreflexivity 
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Asymmetry implies irreflexivity, as being formally stated below. 
Lemma 19 (Va, (3, a~<f3^(3-/^a)^ Va, a 7^ a 

Proof Instantiate /3 with a. □ 
Transitivity of the negation of a relation does not imply transitivity of the 
relation. For instance, let a (3 and define -< on {a, (3} hy a ^ f3 and f3 ^ a, and 
nothing more. Due to the symmetry, -< is not transitive, while 7^ is transitive. 
The next definition and two lemmas shows that transitivity of the negation 
almost implies transitivity. 

Definition 20 (Strict weak order) A strict weak order is an asymmetric re- 
lation whose negation is transitive. 

Equivalent definitions of strict weak order can be found in the literature. 
The rest of this subsection explains some properties of strict weak orders and it 
gives an intuition of the underlying structure. The following lemma shows that 
transitivity of a relation can be derived from asymmetry of the relation and 
transitivity of its negation. 

Lemma 21 A strict weak order is transitive. 

Proof Let a, /? and 7 be such that a ~< P and /3 ^ 7. Therefore (3 -/^ a and 
7 7^ /? by asymmetry, and 7 7^ a by transitivity of the negation . If a 7^ 7 then 
/? 7^ a and transitivity of the negation yields /? 7^ 7, which is absurd. Therefore 
0^7. □ 

Strict weak orders have a second property that makes non-comparability an 
equivalence relation. 

Lemma 22 // -< is a strict weak order, then jj is an equivalence relation. 

Proof If -'{a^a) then a -< a, which contradicts asymmetry by lemma 1191 
So jl is reflexive. If att/? then (3'ia by definition, so jj is symmetric. If and 
/3ji7, then /3 7^ a and 7 7^ /3 by definition. So 7 7^ a by transitivity of the 
negation. In the same way, a 7^ 7 also holds, so a'i'y. Therefore jj is transitive. 
The incomparability relation is symmetric by definition, so ft is an equivalence 
relation. □ 

A binary relation is lower (resp. upper) imitating if any two non-comparable 
elements have the same predecessors (resp. successors). 

Definition 23 (Lower/upper imitation) A binary relation ^ complying with 
the following formula is called a lower-imitating relation. 

(att/3 A7^q;)^7^/? 

A binary relation -< complying with the following formula is called a upper- 
imitating relation. 

{a^P Aa-(7)^/3-<7 
A relation that is both lower and upper imitating is called an imitating relation. 
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Lower and upper imitations do not only look "symmetric" definitions, they 
also are. 

Lemma 24 // a relation is lower (resp. upper) imitating, then its inverse is 
upper (resp. lower) imitating. 

Proof Let -< be a binary relation. Assume that -< is lower imitating and 
assume that and /3 >- 7. So ajj/? and j ^ p, which implies 7 a, and 

therefore a )^ 7. □ 

Guaranteeing asymmetry makes the predicates of lower and upper imitations 
coincide. 

Lemma 25 Let ~< be an asymmetric relation. In this case, -< is upper-imitating 
iff ~< is lower-imitating. 

Proof left-to-right. Assume ajJ/3 and 7 ^ /3. If a ^ 7 then ^ 7 by upper- 
imitation, which contradicts asymmetry. If a]),'-/ then a -< /3 by upper-imitation, 
which is absurd. So 7 -< a. The converse follows lemma 1241 knowing that the 
inverse of an asymmetric relation is asymmetric. □ 

Because of the lemma above, only the concept of imitation will be referred to 
when dealing with asymmetric relations. The next lemma connects the notion 
of imitation to the notion of transitivity. 

Lemma 26 // -< is transitive and j:) is an equivalence relation, then -< is ir- 
reflexive and imitating. 

Proof U a ^ a then jj is not reflexive, which contradicts the assumption. So 
-< is irreflexive. Assume that att/? and /3 ^ 7. If 7 ^ a then a ^ /3 by transitivity, 
which is absurd. If j^a, then /3tt7 by transitivity of fl, which is absurd. Therefore 
a ^ 7. □ 

Imitation implies transitivity provided that "small" cycles are forbidden. 

Lemma 27 Let -< be without any cycle involving 2 or 3 elements. If ~< is 
imitating then -< is transitive. 

Proof Assume a ^ f3 and /3 7. If 7 ^ a then there is a cycle involving 3 
elements, which is absurd. Now assume that 7jla. If -< is imitating then /3 -< a, 
which contradicts asymmetry. So a -< 7. □ 

Actually, an imitating relation is a strict weak order provided that "small" 
cycles are forbidden. 

Lemma 28 Let -< be without any cycle of length 2 or 3. If -< is imitating then 
-< is a strict weak order. 

Proof Let a, (3 and 7 be such that (i a and 7 7^ /3. First case, assume 
that ajJ/J and (3'^^. If 7 ^ a then (3 ^ a and 7 /3 by double imitation. Since 
transitivity is guaranteed by lemma 1271 this yields 7^0; which is absurd by 
assumption. Second case, either att/3 and /? -< 7 or a ^ /? and /3jJ7. By imitation, 
a ^ 7, so 7 7^ a by asymmetry. Third case, a ^ (3 and /3 -< 7, so a ^ 7 by 
transitivity, so 7 7^ a. □ 
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The picture below is meant to give an intuitive understanding of what is a 
strict weak order. The circles represent equivalence classes of fl. Here we have 
7 ^ a, /3, (5 and 7, a, /? -< 5 and aji/3. Informally, a strict weak order looks like a 
knotted rope. 




The following lemma sums up the results of this subsection. 

Lemma 29 Let -< he a binary relation, and let (j be the corresponding non- 
comparability relation. The following three propositions are equivalent. 

1. -< is a strict weak order. 

2. -< is transitive and jj is an equivalence relation. 

3. -< is imitating and has no cycle of length 2 or 3. 

Proof Implication 1 2 by lemmas [H] and [HI implication 2 => 3 by 
lemma [551 and implication 3 ^ 1 by lemma [HI □ 

3.2 Binary Relations over Sequences 

This subsection deals with binary relations over (finite or infinite) sequences built 
over (finite or infinite) collections. It introduces a few notions such as E-prefix, 
A-transitivity and subcontinuity. 

For binary relations over sequences, the following captures the notions of 
preservation by prefix elimination and preservation by prefix addition. 

Definition 30 (E-prefix and A-prefix) A binary relation -< over sequences 
is said E-prefix when complying with the following formula. 

ua ^ uf3 a -< /3 

It is said A-prefix when complying with the following formula. 

a ^ P ^ ua ^ uP 

It is possible to define a mix between transitivity and A-prefix. 

Definition 31 (A-transitivity) A relation over sequences is said A-transitive 
when complying with the following formula. 

a ^ P ^ uf3 ^ J ^ ua ^ J 

The following lemma shows the connections between transitivity, A-prefix, 
and A-transitivity. Note that the converse implications do not hold a priori. 

Lemma 32 Transitivity plus A-prefix imply A-transitivity, and A-transitivity 
implies transitivity. 

Proof Consider the formula defining A-transitivity. For the first claim, ua -< 
up by A-prefix, and conclude by transitivity. For the second claim, instantiate 
u with the empty sequence. □ 
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The following lemma shows that a strict weak order that is preserved by 
prefix elimination is A-transitive. 

Lemma 33 An E-prefix strict weak order is A-transitive. 

Proof Assume that a -< /3 and u/3 -< 7. Therefore a hy asymmetry, so 

uP 7^ ua by contraposition of E-prcfix. If ua 7 then uf3 7^ 7 by transitivity of 
the negation, which contradicts the assumption. Therefore ua -< j. □ 

The A-prefix predicate seems to be a bit too restrictive for what is intended 
in this chapter, but a somewhat related notion will be useful. Informally, consider 
a relation -< that is A-prcfix and transitive. If a -< uq then ua -< u^a and we 

have an infinite ascending chain a -< ua ■ ■ ■ -< u^a -< In this case, a 

natural thought might be to topologically close the chain with as an upper 
bound, i.e. a ~< ua ■ ■ ■ -< u^a -< ■ ■ ■ -< u^. The following definition captures 
this informal thought. 

Definition 34 (Subcontinuity) A relation over sequences is said suhcontin- 
uous when complying with the following formula, where u is any non-empty finite 
sequence. 

a -<ua => u"^ ^ a 

The next definition proceeds in the vein of the previous one and gives an 
alternative, slightly more complex definition of subcontinuity. 

Definition 35 (Alt-subcontinuity) A relation over sequences is alt-suhcontinuous 
when complying with the following formula, where v and t are any non-empty 
finite sequences. 

a^tp ^ {va~<l3 V a< {tv)'^) 

The next lemma shows that alt-subcontinuity is "stronger" than subcontinu- 
ity. 

Lemma 36 An alt-suhcontinuous asymmetric relation is suhcontinuous. 

Proof Let -< be an alt-subcontimious asymmetric relation. Assume that a -< 
ua for some u and a. By alt-subcontinuity, ua -< a W a ~< u'^. By asymmetry, 
ua a, so a -< u'^ . Therefore u'^ 7^ a by asymmetry. □ 

The following lemma states that, under some demanding conditions, subcon- 
tinuity implies alt-subcontinuity. 

Lemma 37 A E-prefix suhcontinuous strict weak order is alt-suhcontinuous. 

Proof Assume that va f3,a {tvY , and a -< t(3. If {tvY ^ t(3 then a y^ t/3 
by transitivity of 7^, which is a contradiction, so (to)" -< tp. So (vt)'^ /? by E- 
prefix. If (vt)^ 7^ va then (vt)" 7^ /3 by transitivity of 7^, which is a contradiction, 
so (wt)" -< va, and (tv)'^ ~< a. By subcontinuity, this implies a yi. tva. By 
assumption, va 7^ /3, so tva tp by contraposition of E-prefix. Therefore a y^ tp 
by transitivity of the negation, which contradicts the assumption, so a 7^ tp. □ 
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The following two definitions generalise the notion of E-prefix. 

Definition 38 Let W be a non-empty finite set of finite sequences such that 
the empty sequence is not in W and such that at most one sequence of length 1 
is in W. If for all walks u in W there exists a walk v inW such that ua -< vf3, 
one writes Wa -< W (3. 

Definition 39 (Gen-E-prefix) A relation over sequences is said gen-E-prefix 
when complying with the following formula. 

Wa <WI3 ^ a < 13 
4 Equilibrium Existence 

Subsection 14. II proves a sufficient condition that guarantees existence of equilib- 
rium in any dalograph; subsection l4. 21 gives a few examples of non-trivial relations 
meeting the requirements of the sufficient condition; subsection 14.31 applies the 
result to network routing. 

4.1 The Proof 

The two main stages of the proof are, first, building hereditary maximal paths, 
which are the only paths involved in equilibria, and second, proceeding by in- 
duction on the number of arcs in the dalograph. 

Hereditary maximal paths seem difficult to be built a priori. A weaker no- 
tion is that of semi-hereditary maximal path. On the one hand, a subpath of a 
hereditary maximal path is a maximal continuation of the preceding node along 
the hereditary maximal path. On the other hand, a subpath of a semi-hereditary 
maximal path is a maximal continuation of the beginning of the semi-hereditary 
maximal path, as defined below. 

Definition 40 (Semi- hereditary maximal path) Letx be a non-empty walk 
of continuation F . If m{xy, F') for all decompositions F — yF' where xy is a 
walk, one writes shm{x, F). 

Unsurprisingly, semi-hereditary maximality implies maximality. 

Lemma 41 shm{x, F) ^ m{x, F) 

Proof Instantiate y with the empty walk in the definition of shm. □ 

The next result states that semi-hereditary maximality is implied by maxi- 
mality plus semi-hereditary maximality of the subpath starting one node further 
along the path. 

Lemma 42 m{x, oF) ^ shm{xo, F) ^ shm{x, oF) 

Proof Consider a decomposition oF — yF' where xy is a walk. If y is empty 
then F' = oF so m{xy, F') by assumption. If y is not empty then y = oz. Since 
F — zF' and shm{xo,F), it follows that m(xoz, F'). Hence shm{x,oF). □ 
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The notion of semi-hereditary maximahty can also be defined along an- 
other induction principle for walks. In such a case, the definition would look 
like lemma I3H 

As to the nibbling induction principle for walks in subsection 12.21 it will be 
exploited as a recursive programming principle instead. It is used below to define 
a function that expects a non-empty walk and returns a path. It starts from one 
given node, finds a direction that promises maximality, follows the direction until 
there is a better direction to be followed, and so on, but without ever going back. 
It stops when the walk is looping because a looping walk defines a path. It is 
called the seeking-forward function. 

Definition 43 (Seeking-forward function) Let -< be an acyclic preference 
and let g be a dalograph. Define a function that expects a non-empty walk in g 
and a continuation of this walk. More specifically, F{x, F) is recursively defined 
along the nibbling induction principle for walks. 

— If X is a looping walk of continuation F, let F{x, F) = F . 

— If X is not a looping walk then case split as follows. 

L If m{x, F) then F(x, F) — oF{xo, F'), where F = oF' . 
2. If -im{x, F) then F{x, F) = oF{xo, F') for some oF' such that m{x, oF') 
and x'-F ~< x^oF' . 

The following lemma states that whatever the point of view, a path processed 
by the seeking-forward function is somehow not worse than the original path. 
Before reading the lemma recall that given u a non-empty finite sequence, 
(resp. u') represents the first (resp. last) element of u. 

Lemma 44 Let -< be an irreflexive and A-transitive preference. Let u be a 
non-empty suffix of x. The following formula holds. 

uF{x, F) A ^ uF < u^'A 

Proof By nibbling induction on walks. Base step, a; is a looping walk of 
unique continuation 7^. By definition of F we have F{x, F) = F, so the claim 
holds. Inductive step, case split on 7^ being or not a maximal continuation of 
X. First case, m{x,F), so F{x,F) = oF{xo,F') with F = oF'. Assume that 
uF{x,F) -< ufA, so oF{xo,F') -< A. By induction hypothesis, uoF' -< A, 
so uF -< uf A. Second case, ^m(x, F), so F{x, F) — oF{xo, F') and x^F -< x^oF' 
for some oF' maximal continuation of x. Assume that uF{x, F) -< A, so 
uoF{xo, F') -< A. By induction hypothesis, uoF' -< A. Since u is a non- 
empty suffix of X, we have = xK It follows that u''F -< u^oF' . By A-transitivity, 
uF -< ufA. □ 

The next lemma describes an involution property of the seeking-forward func- 
tion, which suggests that seeking-forward once is enough. 

Lemma 45 Let -< be an irreflexive and A-transitive preference. The following 
formula holds. 

Fix,Fix,F))=Fix,F) 
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Proof By nibbling induction on walks. Base step: a; is a looping walk of unique 
continuation F. By definition of F we have F{x,F) — F, so F{x,F{x,F)) = 
F{x,F). Inductive step: by definition of F, F{x,F) = oF{xo,F') for some oF' 
suclithatm(a;,or'). So F{x, F{x, F)) = F{x,oF{xo,F')). Since ni(xo,F{xo,F')) 
by contraposition of lemma l44l F{x, oF{xo, F')) — oF{xo, F{xo, F')). By induc- 
tion hypothesis, F{xo, F{xo, F')) = F{xo,F'), so F{x,F{x,F)) = oF{xo,F') = 
F{x,F). □ 

The next analytical property about the seeking-forward function shows that 
a subpath of a fixed point is also a fixed point. 

Lemma 46 Let ^ be an irreflexive and A-transitive preference, and let xo be 
a walk. Fhe following formula holds. 

F{x, oF) =oF ^ F{xo, F)=F 

Proof By definition of F, F{x,oF) = o'F{xo',F') for some o'F'. It follows 
that o' = o and F{xo, F') = F. Therefore F{xo, F{xo, F')) = F{xo, F) by term 
substitution. By lemma H51 F{xo, F{xo, F')) ~ F{xo,F'), therefore F{xo,F) = 
F by transitivity of equality. □ 

The following lemma states that any fixed point of the seeking-forward func- 
tion is a semi-hereditary maximal path. The converse also holds and the proof 
is straightforward, but this converse result is not relevant in this chapter. 

Lemma 47 Let -< be an irreflexive, E-prefix, and A-transitive preference. The 
following formula holds. 

F{x,F) = r ^ shm{x,F) 

Proof By nibbling induction on the walk x. Base step, a; is a looping walk, 
so m{x, F) by definition of m. For any decomposition F = yF' where xy is a 
walk, y is empty and F' — F because x is a looping walk, so m{xy, F'). This 
shows shm(x, F). Inductive step, assume that F{x^ oF) = oF. So F{xo, F) — F 
according to lemma l46l and shm{xo, F) by induction hypothesis, so m(xo,F) 
by lemma HT] If -^m{x,oF), there exists a path xo'F' such that x'^oF -< x^o'F' 
and F(x, oF) — o'F{xo' , F'). So o' — o, and oF -< oF' since ~< is E-prefix, which 
contradicts m{xo,F). Therefore m{x,oF), and lemma allows concluding. □ 

The next lemma gives a sufficient condition so that semi-hereditary maxi- 
mality implies hereditary maximality. 

Lemma 48 Let -< be an irreflexive, E-prefix, and A-transitive preference whose 
inverse of negation is alt-subcontinuous, and let g be a dalograph. 

shmg^^{o, F) hmg^^{oF) 

Proof Assume that shm{o, F). It suffices to prove by induction on the walk 
X that oF = xoiFi implies m{oi,Fi). First case, x is empty, so o = oi and 
Fi = F. Since shm{o, F) by assumption, m{oi, Fi) by definition of shm. Second 
case, assume that oF — xd o\F\ and let oxFi be a path. If xo\F2 is a path, 
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oFi 7^ 0/2 by semi- hereditary maximality of F. If 0:01/2 is not a path, then x 
and /2 intersect. Let 02 be the first intersection node along So x — U02V and 
J2 = ^2/3, with xoito2 being a looping walk. The situation is displayed below. 




01/2 is a path so 02/3 is also a path. Since oF = UO2VO1F1 and u is smaller 
than X, the induction hypothesis says that m(o2,voiFi). Therefore 02VO1F1 7^ 
O2/3. Because xoito2 is a looping walk, u{o2VOit)'^ is a path, by definition, and 
so is {o2VOit)'^ . Since m(o2,voiFi), we have {o2VOit)'^ -< 02VO1F1. Let a be the 
sequence induced by oiA, P by 02/3, ?/ by 02VO1, and z by oito2. We have 
ya -/^ P and a 7^ {zy)^ , so a ^ zf3 by alt-subcontinuity of the inverse of the 
negation. Therefore oiFi 7^ oito2Fj,, which shows that m{oi,Fi). □ 

Now that hereditary maximal paths are available/computable, it is possible 
to prove the existence of equilibrium for every dalograph, by induction on the 
number of arcs in the dalograph. Compute one hereditary maximal path and 
remove the arcs that the path ignored while visiting adjacent nodes. Compute 
an equilibrium on this smaller dalograph and add the ignored arcs back. This 
yields an equilibrium for the bigger dalograph. This procedure is detailed below. 

Theorem 49 // a preference is included in a subcontinuous E-prefix strict weak 
order, then any dalograph has a global equilibrium with respect to the preference. 

Proof According to lemma [151 it suffices to show the claim for preferences 
that are actually subcontinuous E-prefix strict weak orders. Proceed by induction 
on the number of arcs in the dalograph. If the dalograph has one arc only, we are 
done since there is only one possible strategy and since preference is irreflexive. 
Now assume that the claim is proved for any dalograph with n or less arcs, and 
consider a dalograph g with n + 1 arcs. If each node has only one outgoing arc, 
we are done by lemma [TTl Now assume that there exists a node o with at least 
two outgoing arcs as shown below. 

o 

• • 

Since the preference is a subcontinuous E-prefix strict weak order, it is ir- 
reflexive, A-transitive, E-prefix, and alt-subcontinuous by lemmas \T9\ l33l and [37l 
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According to lemmas SSJ H7] and [35] there exists a hereditary maximal path F 
starting from the node o. Let u{av)'^ be the corresponding sequences of labels, 
where u and v are finite (possibly empty) sequences of labels and a is a label. 



From the dalograph g and the path F, build a new dalograph g' as follows. 
Remove all the arcs that are dismissed by the choices along F. There is at least 
one such arc since F starts at node o, which has two or more outgoing arcs. 
Below, the dalograph g is to the left and the dalograph g' to the right. 




The new dalograph g' has n or less arcs, so it has an equilibrium by induction 
hypothesis. Such an equilibrium is represented below and named s' . The double 
lines represent the choices of the strategy, one choice per node. 




The path induced by s' from the node o is the same as F because there is 
only one possible path from this node in the dalograph g' , after removal of the 
arcs. From the equilibrium s', build a new strategy named s by adding back the 
arcs that were removed when defining g' , as shown below. 



• • • 




The remainder of the proof shows that s is an equilibrium for g. Since F is 
hereditary maximal, s is a local equilibrium for any node involved in F. Now let 
o' be a node outside F, and let F' be the path induced by s (and s') starting 
from o' . Consider another path starting from o' . If the new path does not involve 
any arc dismissed by F^ then the new path is also valid in g' , so it is not greater 
than F' since s' is an equilibrium. If the new path involves such an arc, then the 
situation looks like the picture below, where F — vF" and the new path is uA. 

20 



r u V 




r" A 

1 \ 

By hereditary maximality, F" 7^ Z\, so uF" 7^ uA by contraposition of E- 
prefix. The path uF" is also vahd in <?', so F' uF" because s' is an equihbrium. 
Therefore F' uA by transitivity of the negation. Hence, F' is also maximal in 
g, and s is an equilibrium. □ 



4.2 Examples 

This subsection gives a few examples of non-trivial relations included in some 
subcontinuous E-prefix strict weak order. First, it discusses the lexicographic 
extension of a strict weak order, and a component-wise order in Pareto style, 
which happens to be included in the lexicographic extension. Second, it defines 
two limit-set orders involving maxima and minima of a set. The second order 
happens to be included in the first one. 

Lexicographic extension The lexicographic extension is widely studied in the 
literature. It is the abstraction of the way entries are ordered in a dictionary, 
hence the name. The lexicographic extension usually involves total orders, but 
it can be extended to strict weak orders. 

Definition 50 (Lexicographic extension) Let (A, ^) be a set equipped with 
a strict weak order. The lexicographic extension of the strict weak order is defined 
over infinite sequences of elements of A. 

aa bp aa bp 

For instance 01'^ -<'«^ 10'^ and (03)'^ -<'«^ l'^ -<''=^ (30)'^, with the usual 
order on figures 0, 1 and 3. 

The following defines when two sequences of the same length are "equivalent" 
with respect to a strict weak order. 

Definition 51 Let [A, be a set equipped with a strict weak order. Let u and 
V he two sequences of length n of elements of A. If for all i between 1 and n, 
Ui^Vi, then one writes u'^v. 
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Next lemma characterises the lexicographic extension of a strict weak order 
through equivalent prefixes followed by comparable letters. 

Lemma 52 Let {A, -<) be a set equipped with a strict weak order, and let ^'"^^ 
be its lexicographic extension. 

a -<''=^ /3 
t 

3u, V £ A*,3a,b e A, 3a', /3' e A", a = uaa' A (3 = vb(3' f\ u^v A a 

Proof left-to-right: by rule induction. First rule, a ^'^^ /3 comes from a ^ b, 
so a = aa' and f3 — 5/3' for some a' and /?'. Second rule, a -<''^^ f3 comes from 
a' -<^^^ (3' and att5. The induction hypothesis provides some u, w; au and bv are 
witnesses of for the claim. Right-to-left. By induction on the length of u. If u is 
empty then the claim corresponds to the first inference rule. For the inductive 
step, invoke the second inference rule. □ 

The following lemma states the transitivity of the lexicographic extension of 
a strict weak order. 

Lemma 53 Let (A, -<) be a set equipped with a strict weak order. Then -<^^^ is 
transitive. 

Proof Assume that a ■^''^^ (3 and (3 -<^'^^ 7. By lemma [SH this gives one 
decomposition a — uaa' and [3 — ubf3' with a ~< b, and one decomposition 
f3 = vb'f3" and 7 = UC7' with b' ~i c. Therefore (3 = ub/3' = vb'l3". Case split 
along the following three mutually exlusive cases: first u — v, second u is a 
proper prefix of and third w is a proper prefix oi u. li u — v then b — b' so 
a ^ c by transitivity of so a ^''^^ 7 by lemma [52l If u is a proper prefix of v 
then u = vb'v', so a = vb'v'a' and 7 = WC7' with b' -< c, therefore a -<^'^^ 7 by 
lemma [52I If w is a proper prefix of u then v — ubu', so a = uaa' and 7 = ubu'j' 
with a ^ 6, therefore a -4^^ 7 by lemma [52l □ 

By contraposition, lemma [52] yields the following characterisation of -/^^^ ^ 
the negation of -^'^^ , 

Lemma 54 Let (A, ^) be a set equipped with a strict weak order, and let -^'^^ 
be its lexicographic extension. 

a 7^'^=^ /3 
\ 

Vm,u e A*,Va,6 e A,Va',/3' £ , a ^ uaa' A (3 = vbf3' A u'^v ^ a b 

The construction of the lexicographic extension preserves strict weak order- 
ing, as stated below. 

Lemma 55 Let (A, -<) be a set equipped with a strict weak order. The derived 
-<^^^ is also a strict weak order. 
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Proof Since -^^'^ is transitive by lemma [551 it suffices to show that jj'^^ is an 
equivalence relation, by lemmaUHl The relation -('^^ is irreflexive, which can be 
proved by rule induction on its definition. So jj''^^ is reflexive. It is also symmetric 
by definition. By lemma 1541 att'"^^/? is equivalent to ujjt; for all decompositions 
a — ua' and (3 — w/3' with u and v of the same length. This property is transitive 
since jj is transitive by lemma □ 

The lexicographic extension of a strict weak order is E-prefix. 

Lemma 56 Let [A, ~<) be a set equipped with a strict weak order. The derived 
-i}'^^ is E-prefix. 

Proof Prove by induction on u that ua ^'"^^ ii/3 implies a -^'"^^ (3. If u is 
empty, that is trivial. If w = au' , then au'a ^''^^ au' (i must come from the 
second inference rule of the definition of -<''=^, which means that u'a -^''^^ u'j3. 
Therefore a ^''^^ /3 by induction hypothesis. □ 

The lexicographic extension of a strict weak order is also subcontinuous. 

Lemma 57 Let [A, ^) he a set equipped with a strict weak order. The derived 
-^'•^^ is subcontinuous. 

Proof Assume that -<''^^ a, so u'^u'jjtV, u = u'au", a = vba' , and a < h 
for some n, it', m", a, h and a' . Therefore u'^'^^u'^^uv, which can be written 
u'^u' au"u'^uv. Decompose uv = v' cv" with v" and u"u' of the same length. 
So u"u''^v' and aftc. So c 6 by strict weak ordering and v'^v' since jl is an 
equivalence relation. Since ua = v' c(v"ba') and a = w6a', ua -<^'^^ a. Therefore 
_^iex subcontinuous. □ 

Theorem together with lemmas and [571 allows stating the following. 

Theorem 58 A dalograph labelled with elements of a strict weak order has a 
global equilibrium with respect to the lexicographic extension of the strict weak 
order. 



Pareto Extension A Pareto extension allows comparing vectors with compa- 
rable components. A first vector is "greater" than a second one if it is not smaller 
component- wise and if it is greater for some component. This can be extended 
to infinite sequences. 

Definition 59 (Pareto extension) Let [A, be a set equipped with a strict 
weak order. The Pareto extension of the strict weak order is defined over infinite 
sequences of elements of A. 

a<^ P = Vn e N, (3{n) ^ a(n) A 3n £ N, a(n) < f3{n) 

For instance Ol'^ 10" but (01)"^ 1'^ (13)" with the usual order on 
figures 0, 1 and 3. 

The following lemma states that a Pareto extension of a strict weak order is 
included in the lexicographic extension of the same strict weak order. 
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Lemma 60 Let {A, -<) be a set equipped with a strict weak order. 

a^^ (3 ^ a -('"^ (3 

Proof Assume that a <^ /?, so by definition (3{n) 7^ a{n) for all naturals 
n, and a{n) -< (3{n) for some natural n. Let uq be the smallest natural n such 
that a{n) -< P{n). So a = uaa' and /? — vba for some u and v of length uq and 
a ^ b. For i between and rip — 1, v{i) -/< u(i) by assumption, and u[i) -/i v{i) 
by definition of riQ. Therefore itftw, so a -<^'^^ (3 by lemma □ 

Pareto extension also guarantees existence of equilibrium in dalographs. 

Theorem 61 A dalograph labelled with elements of a strict weak order has a 
global equilibrium with respect to the derived Pareto extension. 

Proof Invoke lemmas [501 and [121 and theorem [551 n 

Max-Min Limit-Set Order As discussed in subsection l3.11 two non-comparable 
elements of a strict weak order compare the same way against any third ele- 
ment. Therefore, comparison of two elements amounts to comparison of their 
non-comparability equivalence classes. 

Definition 62 Let (E, ^) be a set equipped with a strict weak order. This in- 
duces a total order defined as follows on the ^-equivalence classes M and BK 

A^ <B^ = 3x e A\ 3yeB^,x^y 

Through total ordering, it is easy to define a notion of extrema of finite sets. 

Definition 63 (Class maximum and minimum) Let {E, ^) be a set equipped 
with a strict weak order. The maximum (resp. minimum) of a finite subset A of 
E is the maximal (resp. minimal) '^-class intersecting A. 

An order over sets is defined below. It involves extrema of sets. 

Definition 64 (Max-min order over sets) Let {E, -<) be a set equipped with 
a strict weak order. The max-min order is defined on finite subsets of E. 

A B = max{A) -< max{B) V {max{A) = max{B) A min{A) -< min{B)) 

For instance {1,2,3} {0,4} and {0,2,3} {1,3} with the usual 

total order over the naturals. 

The negation of the above order is characterised below. 

Lemma 65 Let {E, -<) be a set equipped with a strict weak order. 

A 7^*^™ B ^ max{A) 7^ max{B) A {max{A) = max{B) ^ min{A) 7^ min{B)) 

The max-min construction preserves strict weak ordering, as stated below. 
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Lemma 66 Let {E, ^) be a set equipped with a strict weak order. The Max-min 
order on E is also a strict weak order. 

Proof First, prove transitivity of its negation. Assume that A -^^^"^ B and 
B -7^*^™ C. By assumption, max{A) yi. max{B) and max{B) max{C), so 
max{A) 7^ max{C) since ^ is a total order for jj-classes. Assume that max{A) = 
max{C), so max{A) — max{C) — max{B). Therefore min{A) min(B) and 
min(B) -/{ min(C) foUows from the assumptions, and min{A) min(C) by 
total ordering. This shows that A ^^^"^ C. Second, prove that y*^™ is an equiv- 
alence relation: just note that A^^'^"^B is equivalent to max{A) — max{B) and 
min{A) = min{B). □ 

The elements that appear infinitely many times in an infinite sequence con- 
stitute the limit set of the sequence. Sequences with non-empty limit sets can 
be compared through max-min comparisons of their limit sets. 

Definition 67 (Max-min limit-set order) Let {E, -<) be a set equipped with 
a strict weak order. For a infinite sequence over E, let La be its limit set, i.e. 
the set of the elements that occur infinitely often in a. Two infinite sequences 
whose limit sets are non-empty are compared as follows. 

a < P = La ^ Lf3 

For instance 3"'4" ^Mmis 0^(50'?)" because 4^5 according to the usual 
order over the naturals. 

Next lemma states preservation of strict weak ordering by the max-min con- 
struction. 

Lemma 68 Let {E, -<) be a set equipped with a strict weak order. The max-min 
limit-set order is a strict weak order over the sequences with non-empty limit set. 

Since the limit set of a sequence is preserved by prefix elimination and addi- 
tion, the following holds. 

Lemma 69 Let {E, ~<) be a set equipped with a strict weak order. The max-min 
limit-set order is E-prefix and subcontinuous over the sequences of non-empty 
limit set. 

Theorem HHl together with lemmas 1551 and IMl allows stating the following. 

Theorem 70 A dalograph labelled with elements of a strict weak order has a 
global equilibrium with respect to the derived max-min limit-set order. 

Max-Min-Light Limit-Set Order Roughly speaking, the max-min-light or- 
der relates sets such that the elements of one are bigger than the elements of the 
other. 
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Definition 71 ( Max- min- light order) Let (E,^) be a set equipped with a 
strict weak order. The max-min-light order is defined on finite subsets of E. 

^^Mmi^ = \/xeA,\/yeB,yy^x A 3x e A,3y e B, x ^ y 

For instance {1,2} 7^^^"' {0,3} but {0, 1} {1} {1,2} 

Definition 72 (Max-min-light limit-set order) Let {E, ^) be a set equipped 
with a strict weak order. For a infinite sequence over E , let L^ be its limit set, 
i.e. the set of the elements that occur infinitely often in a. Two infinite sequences 
whose limit sets are non-empty are compared as follows. 

„ jAIrnlls o r ,Mral j 

a ^ P = La -< ijp 

The following theorem states that the max-min-light limit-set order guaran- 
tees equilibrium existence. 

Theorem 73 A dalograph labelled with elements of a strict weak order has a 
global equilibrium with respect to the derived max-min-light limit-set order. 

Proof Note that the max-min-light limit-set order is included in the max-min 
limit-set order. Conclude by lemma [T51 and theorem [701 □ 

4.3 Application to Network Routing 

The following issue is related to existing literature such as [2]. 

Definition 74 A routing policy is a binary relation over finite words over a 
collection of labels. A routing problem is a finite digraph whose arcs are labelled 
with the above-mentioned labels. In addition, one node is called the target. It 
has outdegree zero and it is reachable from any node through some walk in the 
digraph. A routing strategy for the routing problem is a function mapping every 
node different from the target to one of the arcs going out that node. A routing 
strategy is said to be a routing equilibrium if for each node, the path that is 
induced by the strategy starting from that node leads to the target, and if for 
each node, no strategy induces a better (according to the routing policy) such 
path. 

The following lemma gives a sufHcient condition for every routing problem 
to have a routing equilibrium. The condition may not be decidable in general, 
but it is decidable on the domain of every finite routing problem. 

Lemma 75 // a routing policy is (included in) an E-prefix strict weak order 
-<"'' such that V -/C uv for all v and u, then every routing problem has a routing 
equilibrium. 
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Proof A routing problem can be transformed into a dafograph as foUows. 
Add a dummy node to the routing problem, which is a digraph. Add an arc 
from the target to the dummy node and from the dummy node to itself. Add 
dummy labels dl on both arcs. From the routing policy -<'' over finite words, 
build a preference -< over the union of two sets. The first set is made of the 
infinite words over the original labels L (without the dummy label) . The second 
set is made of the concatenations of finite words over the original labels and the 
infinite word dl'^ built only with the dummy label. 

u V a e L'^ u E L* 

udr -< vdr a -< udr 

Since is E-prefix by assumption, -< is also E-prefix. Since v -/(^ uv for all 
V and u by assumption, -< is subcontinuous. Therefore the built dalograph has 
a global equilibrium, by theorem 1491 This global equilibrium corresponds to a 
routing equilibrium. □ 



5 Simple closures 

This section introduces the notion of simple closure, which characterises some 
operators on relations, and the notion of union of simple closures. This yields 
two monoids whose combination is similar to a semiring (distributivity is in 
the opposite direction though) . This development intends to show that if given 
simple closures preserve a predicate, then any finite restriction of their union 
also preserves this predicate. This result will be usefuU in section [6l 

The section starts with the following general lemma. It states that if a pred- 
icate is preserved by given functions, then it is preserved by any composition of 
these functions. 

Lemma 76 Let /o to /„ be functions of type A A. Let Q he a predicate 
on A. Assume that each fk preserves Q. Then for all x in A and all w words on 
the fk the following formula holds. 

Q{x) ^ Q{w{x)) 

Proof By induction on w. First case, w is the empty word, i.e. the identity 
function. So x equals u'(x), and Q{x) implies Q{w{x)). Second case, w equals 
fkw' and the claim holds for w' . Assume Q{x), so Q{w'{x)) by induction hy- 
pothesis, and Qifk ° w'{x)) since fk preserves Q. □ 

In the remainder of this section, the function domain A that is mentioned 
in lemma [75] above will be a set of relations. More specifically, A will be the 
relations of arity r, for an arbitrary r that is fixed throughout the section. In 
addition, the symbol X represents a vector (Xi, . . . , Xr) of dimension r. 

Usually in mathematics, the closure of an object is the smallest bigger (or 
equal) object of same type that complies with some given predicates. What fol- 
lows describes a certain kind of closures for relations of arity r, namely simple 
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closures. Simple closures are operators (on relations of araity r) inductively de- 
fined through inference rules. The first rule ensures that the simple closures are 
bigger or equal than the original relation. The other rules pertain to the intended 
properties of the simple closure. 

Definition 77 Let f be an operator on relations of arity r. The operator f is 
said to be a simple closure if it is inductively defined with the first inference rule 
below and some rules having the same form as the second inference rule below. 

fimx) 

The next lemma states a few basic properties involving simple closures and 
inclusion. 

Lemma 78 Let f be a simple closure. The following formulae hold. 

- RC f{R) 

- RCR' ^ f{R) c f{R') 

- fofiR)cf{R) 

Proof The first claim follows the first rule R{X) ^ f{R){X). The second 
claim is proved by rule induction on the definition of /. First case, f{R){X) 
comes from R{X). By inclusion, R'{X), so f{R'){X). Second case f{R)iX) 
comes from Ai(zcf{R){X^). By induction hypothesis, Aifzcf{R'){X^), therefore 
f{R'){X). The third claim is also proved by rule induction on the definition of 
/. First case, / o f{R){X) comes from f{R){X) we are done. Second case / o 
f{R){X) comes from hi(zc f o f {R){X^) . By induction hypothesis, K,^c f{R){X^), 
so f{R){X). □ 

The following lemma generalises the first property of lemma 1781 

Lemma 79 Let fo to fn be simple closures on relations of arity r, and Let w, 
u, and V be words on the fk ■ For all R relation of arity r and for all X vector 
of dimension r, the following formula holds. 

w{R){X) ^ uwv{R){X) 

Proof First, prove the claim for empty v by induction on u. If u is empty then 
it is trivial. If m = fiu' then u'w{R){X) by induction hypothesis, so fiu'w{R){X) 
by the first part of lemma lTSI Second, prove the claim for empty u by induction on 
V. Ifv is empty then it is trivial. lfv = v' fi then wv' {R){X) by induction hypoth- 
esis. Since R C fi{R) by the first part of lemma [751 we also have wv' fi{R){X) 
by the second part of lemma [78l Third, assume w{R){X). So uw{R){X) by the 
first part of this proof, and uwv{R){X) by the second part of this proof. □ 
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Definition 80 (Rule union) Let f and g be two simple closure on relations 
of arity r. Assume that f is defined by the induction rules Fi to Fn, and that g 
is defined by the induction rules Gi to Gm ■ Then, the operator f + g defined by 
the induction rules Fi to Fn and Gi to Gm is also a simple closure on relations 
of arity r. 

The law + defines an abelian monoid on simple closures on relation of the 
same arity, the neutral element being the identity operator. Moreover the law + 
is distributive over the law o, but it should be the opposite for [A A, +, o) to 
be a semiring. 

The union of two simple closures yields bigger relations than simple closures 
alone, as stated below. It is provable by rule induction on the definition of /. 

Lemma 81 Let R be a relation and let f and g be simple closures. The follow- 
ing formula holds. 

fiR)C{f + g){R) 

The following lemma generalises the previous result. It shows that composi- 
tion is somehow "bounded" by union. 

Lemma 82 Let fo to fn be simple closures on relations of arity r, and let f 
equal So<k<nfk- Let w be a word on the fk. For all R relation of arity r, we 
have w{R) C /(i?). 

Proof By induction on w. If w is empty then w{R) =^ R and the first part 
of lemma [78] allows concluding. If w = fiw' then w'{R) C f{R) by induction 
hypothesis. So C / o f{R) by lemma [HI and fiw'{R) C f{R) by the 

third part of lemma [78l □ 
Although composition is " bounded" by union, union is approximable by com- 
position, as developed in the next two lemmas. For any relation R of arity r, the 
union of given simple closures (applied to R) can be simulated at a given point 
X by some composition of the same simple closures (applied to R), as stated 
below. 

Lemma 83 Let fo to fn be simple closures on relations of arity r, and let f 
equal Z!o<k<nfk- Let R be a relation of arity r. Lf f{R){X) then w{R){X) for 
some word w on the fk. 

Proof By rule induction on the definition of /. First case, assume that 
f{R){X) comes from the following rule. 

fimx) 

Since R{X) holds, id{R){X) also holds, so the empty word is a witness for the 
claim. Second case, assume that f{R){X) is induced by the following rule. 

K{X,{X^Uc) A^^cfiR)iX') 

fimx) 
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By induction hypothesis, for all i in C, implies that Wi{R){X^) for 

some word Wi. Let w be a concatenation of the Wi. By lemma I79[ we have 
w{R){X^) for all i. Assume that the inference rule above comes from fk- By 
lemmaEH fk+i ■ ■ ■ /„w(i?)(X') holds for aU i. So, fkfk+i ■ ■ ■ fnw{R){X) by ap- 
plying the inference rule. So /o . . . fnw{R){X) by lemma [79] again. Therefore the 
word /o • . . fnW is a witness, whatever fk the inference rule may come from. □ 

For any relation R of subdomain S, the union of given simple closures (applied 
to R) can be approximated on 5' by a composition of the same simple closures 
(applied to R), as stated below. 

Lemma 84 Let fo to f„ be simple closures on relations of arity r, and let f 
equal Skfk- Let R be a relation of arity r, and let S be a finite subdomain of R. 
There exists a word w on the fk such that f{R) \s is included in w{R). 

Proof Since S is finite, there exist finitely many X in S such that f{R){X). 
For each such X there exists a word u such that u{R){X), by lemma [83l Let 
If be a concatenation of all these u. By lemma [79l w{R){X) for each such X. 
Therefore f{R) \s is included in w{R). □ 

The following lemma shows that if given simple closures preserve a predicate 
that is also preserved by subrelation, then any finite restriction of the union of 
the closures also preserves the predicate. 

Lemma 85 Let Q be a predicate on relations that is preserved by the simple 
closures /o to f„ o,nd subrelation, i.e. R d R' =^ Q{R') ^ Q{R). Then for all 
relations R of finite subdomain S, Q{R) implies Q{Ekfk{R) \s)- 

Proof Lemma IMl provides a w such that f{R) \s is included in w{R). Then 
lemma [76] shows that Q(w{R)), and preservation by subrelation allows conclud- 
ing. □ 

6 Preservation of Equilibrium Existence 

This section defines (gen-) E-prefix and A-transitive closure. These are closely 
related to the (gen-) E-prefix and A-transitivity predicates that are defined in 
subsection [321 It is shown that these closures preserve equilibrium existence, i.e. 
if every dalograph has an equilibrium with respect to a preference, then every 
dalograph also has a equilibrium with respect to the closure of the preference. 
A combination of these closures is defined, and it also preserves equilibrium 
existence. 

The E-prefix closure of a binary relation is its smallest E-prefix superrelation. 
It is inductively defined below. 

Definition 86 (E-prefix closure) 



a < (3 
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The following lemma states that if a preference guarantees existence of equi- 
librium for all dalographs, then the E-prcfix closure of this preference also guar- 
antees existence of equilibrium for all dalographs. 

Lemma 87 E-prefix closure preserves existence of equilibrium. Put otherwise, 
if all dalographs have equilibria, then all dalographs have -i'^P -equilibria. 

Proof Let <? be a dalograph. First note that, if a -i'^^ /?, then there exists u 
such that ua -< u(3. (Provable by rule induction). At any node with eligible a 
and (3 such that a -<^p I3, add an incoming path inducing u, as shown below. 




This new dalograph g' has a ^-equilibrium. For any a and /? such that 
a -<'^P (3, the equilibrium does not induce ua when uj3 is possible, so it does 
not induce a when (3 is possible. Removing the newly added walks u yields a 
-^''^'-equilibrium. □ 

The transitive closure of a binary relation is its smallest transitive superre- 
lation. It is inductively defined below according to the usual formal definition of 
transitive closure. 

Definition 88 (Transitive closure) 

a-il3 a<^f3 /3^*7 
a-<* /3 a 7 

For the transitive closure and other closures that are dealt with in this chap- 
ter, it may not be as simple as for E-prefix closure to prove preservation of 
equilibrium existence. It is done in two steps in this chapter. 

Lemma 89 Let ^ be a preference, and let a and (3 be such that a -<* /?. There 
exists a dalograph g with the following properties. 

— Only one "top" node has several outgoing arcs. 

— The dalograph below is a subgraph of the dalograph g. 

^ f3 



— Only (3 may be -<-maximal among the eligible sequences at the top node. 

Proof Proceed by rule induction on the definition of the transitive closure. 
First rule, a (3 comes from a -< /?. The dalograph below complies with the 
requirements. 
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Second nilc, a P comes from a ^* 7 and 7 (3. By induction hypothesis 
there exists one dalograph for a 7 and one for 7 -<* (3, as shown below to the 
left and the centre. In both dalographs, there is a node with several outgoing 
arcs. Fuse these nodes as shown below on the right-hand side. 




By construction any path in either of the two dalographs is still a path in 
the new dalograph, so a non-maximal path is still a non-maximal path. By 
induction hypothesis, if there is a path that is ^-maximal starting from the top 
node, then it induces /3, but not a. Hence, the new dalograph complies with the 
requirements. □ 

The A-transitive closure of a binary relation is its smallest A-transitive su- 
perrelation. It is inductively defined below. 

Definition 90 (A-transitive closure) 

a<(i a /? uf5 7 
a 13 ua 7 

The following result about A-transitivity is a generalisation of the previous 
result about transitivity. 

Lemma 91 Let -< he a preference, and let a and 13 be such that oc (3. There 
exists a dalograph g with the following properties. 

— The dalograph g has the following shape ( dashed lines represent and delimit 
the rest of the dalograph). 




— The path inducing [3 is not branching after the top node. 

— Any equilibrium for g involves the path inducing j3. 

Proof Proceed by rule induction on the definition of the A-transitive closure. 
First rule, the subproof is straightforward. Second rule, ua 7 comes from 
ul3 7 and a (3. By induction hypothesis there exist a dalograph gi for 
u(3 7 and a dalograph g^ for a (3. Cut the path inducing (3 away from 
32 (but the top node), and fuse two nodes as shown below. 
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By induction hypothesis, the node inducing 7 is not branching in gi, so it 
it still not branching in the new dalograph g. In an equilibrium, the node just 
below u must choose /3, by induction hypothesis. So the top node must involve 
the path inducing 7, also by induction hypothesis. □ 

The gen-E-prefix closure is a generalisation of the E-prefix closure. 

Definition 92 (gen-E-preflx closure) 

a<l3 Wa -<"'P W(3 

a ^"'P (3 a '<"'P P 

The following lemma is a step towards a generalisation of lemma [57] about 
E-prefix closure. 

Lemma 93 Let -< be a preference. For any a -<^'^p (3 there exists a dalograph 
g with the following properties. 

— The dalograph below is a subgraph of the dalograph g. 




— Aside from the top node, the paths inducing a and j3 are not branching. 

— Any equilibrium for g involves the path inducing (3. 

Proof By rule induction on the definition of -<'"^^'. First case, a -<*'^p /3 comes 
from a ^ [3. Straightforward. Second case, a -<^'^p (3 comes from Wa ~<'"^p W(3. 
By definition of Wa ^'^^p W(3^ for all u m. W there exists v u\ W such that 
ua -< vl3. So by induction hypothesis there exists a dalograph „ with the 
following properties. 

— The dalograph below is a subgraph of the dalograph gu,v 




— Aside from the top node, the paths inducing ua and v/3 are not branching. 
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— Any equilibrium for (7„ „ involves the path inducing vfi. 

Consider all these dalographs gu,v for u in W. Fuse their top nodes into one 
node. Also fuse their nodes from where either a or /3 starts into one single node. 
This yields a dalograph g' with the following as a subgraph. 




Aside from the central node, the paths inducing a and /3 are not branching. 
Each u and v are represented in the Ui, so any equilibrium for g' involves the 
path inducing /3. □ 

The following lemma states that under some conditions (similar to the conclu- 
sions of the lemmas above) equilibrium existence is preserved by superrelation. 

Lemma 94 Let -< and -<' be two preferences. Assume that ~< is included in -<' 
and that for any a -<' (3, there exists a dalograph g with the following properties. 

— The dalograph below is a subgraph of the dalograph g. 




— The path inducing /3 is not branching after the top node a. 

— Any ~<- equilibrium for g involves the path inducing (3. 

In this case, if all dalographs have -<- equilibria, then all dalographs have -<'- 
equilibria. 

Proof Let 5 be a dalograph. For each 3-uple (o', a, /3) such that a (3 and 
a and (3 are eligible at node 0' in g, do the following. By assumption, there is a 
dalograph go,a,[3 complying with the requirements below. 

— The dalograph below is a subgraph of the dalograph go,a,0- 




— The path inducing /3 is not branching after the top node o. 

— Any equilibrium for go,a,p involves the path inducing (3. 
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Define g'^ ^ p by cutting away from go.a,p the path inducing /3, but leaving the 
top node o. Fuse the node o' from g and the node o from g'^ ^ p- Let g' be the 
dalograph built from g after addition of all g'g ^ p- Let s' be a ^-equilibrium for 
g' . Let us consider again any 3-uple (o',a,/9) such that a ^' (3 and a and /3 
are eligible at node o' in By construction at node o', s' does not induce any 
sequence that is eligible at the top node o of ^ ^. More specifically, s' does not 
induce a at node o'. Since this holds for any of the considered 3-uple, it means 
that s' is also a ^'-equilibrium. Removing the parts of s' that corresponds to all 
the 5o Q, ^ yields a ^'-equilibrium for g. □ 

Thanks to the result above it is now possible to show that, like E-prefix clo- 
sure, (A-) transitive closure, alt-subcontinuous closure, and gen-E-prefix closure 
preserve equilibrium existence. 

Lemma 95 // all dalographs have ^-equilibria, then all dalographs have 
equilibria, ^'^'^ -equilibria, ^'"^^ -equilibria. 

Proof By lemma |94] together with [91] and [93l □ 

The combination closure of a binary relation is its smallest superrelation that 
is A-transitive and gen-E-prefix. 

Definition 96 (Combination closure) 

a (5 ua a (i 

The combination closure preserves equilibrium existence, as stated below. 

Theorem 97 If all dalographs have ^-equilibria, all dalographs have -<'^ -equilibria. 

Proof Let -<he a. preference that guarantees existence of equilibrium. Let g 
be a dalograph and let S be the finite set of all pairs of sequences that are eligible 
in g. The A-transitive closure and gen-E-prefix closure are simple closures, and 
they preserve equilibrium existence by lemmas 1951 Moreover, the combination 
closure is their union, so by lemma [85l the restriction to S of the full closure 
of -< also guarantees existence of equilibrium. Since |5-equilibriimr is also a 
^^-equilibrium by lemma [TBI this allows concluding. □ 



7 Sufficient Condition and Necessary Condition 

After a synthesis of and a discussion about the results obtained so far, this section 
gives a non-trivial example of a relation that does not meet the requirement of 
the necessary condition for equilibrium existence. Finally, a further result on 
network routing application is given. 
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7.1 Synthesis 



Firstly, tliis subsection gathers the main resuhs of this chapter that concern 
existence of equilibrium. Secondly, It points out that if the preference is a total 
order, then the sufficient condition and the necessary conditions coincide. Finally, 
it shows that the necessary condition is not sufficient in general. 

The following theorem presents the sufficient condition and the necessary 
condition for every dalograph to have an equilibrium. The sufhcient condition 
involving the notion of strict weak order is written with few words. However it 
is difficult to compare it with the necessary condition. Therefore, the sufficient 
condition is rewritten in a way that enables comparison. 

Theorem 98 



The preference -<' is E-prefix, subcontinuous, transitive, and irreflexive. 



The preference -<' is (gen-) E-prefix, (A-) transitive, and irreflexive. 
Proof The topmost two propositions are equivalent by lemma 1291 and they 
imply the third proposition by lemma H51 For the last implication, assume that all 
dalographs have ^-equilibria. By theorem 1971 all dalographs have '^-equilibria. 
So is irreflexive, otherwise the reflexive witness alone allows building a game 
without ^"^-equilibrium. In addition, -<'^ is E-prefix and A-transitive, and -< is 
included in -<'^ by construction. □ 
When the preference is a strict total order, the following corollary proves a 
necessary and sufficient condition for all dalographs to have equilibria. 

Corollary 99 Let a preference be a strict total order. All dalographs have equi- 
libria iff the preference is E-prefix and subcontinuous. 

Proof Left-to-right implication: by theorem[551 the strict total order is gen-E- 
prefix and A-transitive, so it is E-prefix and transitive. If -< is not subcontinuous, 
^ a ^ ua for some u and a. So u is non-empty and a -< una, and the 
following dalograph has no equilibrium. 



The right-to-left implication follows directly theorem [98l because a strict total 






order is a strict weak order. 



□ 
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There is a direct proof of this coroUary, some parts of whose are much simpler 
than the proof of theorem For instance, if a total order is E-prefix, then its 
negation is also E-prefix. This ensures that any maximal path is also semi- 
hereditary maximal. Therefore the definition of the seeking-forward function is 
not needed. The necessary condition is much simpler too. Indeed, if -< is not 
E-prefix, we have ua -< u(3 and a -/^ (3 for some u, v, a and p. By the first 
assumption we have a ^ (3, so P ^ a hy total ordering. Therefore the following 
dalograph has no equilibrium. 




In general, the necessary condition is not a sufficient condition, as shown by 
the following two examples. First, let -< be defined as followed. 

Wia;2a2 -< uiai V2Xiai -< U2a2 

vixiyi(i2 < uiai W2a;2y2/3i -"202 

viX2y2f32 -< uiai V2Xiyi(3i < U2a2 

The preference -< complies with the necessary condition but the dalograph 
below has no ^-equilibrium. Indeed, the node Oi "wants" to follow a path leading 
to ai or while the node 02 "wants" to follow a path leading to a2 or [32- 




Second example, let -< be defined as followed. 



ai -< yiX2a2 0,2 < y2X2,a^ as -< y^xiai 

{xiyiY < xzas. {x2y2Y -< Xiai {x^yzY -< ^202 
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The preference -< complies with the necessary condition but the dalograph 
below has no -<-equilibriuin. Indeed, the situation looks like it is in the jurisdic- 
tion of alt-subcontinuity, but it is not. 




X2 2/2 

\/ 

0-2 

i 

It is possible to design closures that rule out the above " annoying" situations. 
For instance, the closure suggested below (by mutual induction) may take care 
of the triskele example (and of any related example with n branches). However, 
this kind of incremental procedure is very likely to leave out some more complex 
examples. 

a ^ /? a<^ vP {uvY 7 a /3 

A^^^ B B ^" C A-<' B A,C ^" B, C 

A ^" C A,C <^ B,C AV~B 



7.2 Example 

The max-min limit-set order is defined in subsection 14. 2i whereas the max-min 
set order is defined below. It does not only consider the limit set of the sequence, 
but every element occurring in the sequence. 

Definition 100 (Max-min set order) Let {E, ^) be a set equipped with a 
strict weak order. For a an infinite sequence over E, let Sa be the set of all 
elements occurring in a. 

jMms /o ^ c .Mm o 
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This order cannot guarantee existence of global equilibrium, as stated below. 

Lemma 101 There exists {E, ^) a set equipped with a strict weak order, such 
that there exists a dalograph that is labelled with elements in E, and that has no 
global equilibrium with respect to the max-min set order. 

Proof Along the usual order over the figures 0, 1 and 2, we have 2(02)'^ ^Mms 
21'^, since {0,2} -<*^'" {1,2}. However, when removing the first 2 of these two 
sequences, we have 1'^ ^*^™" (02)'^ since {1} {0,2}. Therefore any E- 

prefix and transitive relation including is not irreflexive. Conclude by 

theorem |M1 D 

7.3 Application to Network Routing 

In the total order case, the necessary and sufficient condition for equilibrium 
in dalographs yields a necessary and sufficient condition for routing equilibrium 
in routing problems. The necessary condition implication invokes constructive 
arguments that are similar to the ones used for the necessary condition in dalo- 
graphs. However, the proof is simple enough so that just doing it is more efficient 
than applying a previous result. 

Theorem 102 Assume a routing policy that is a total order. Then every 
routing problem has a routing equilibrium iff the policy is E-prefix and uv v 
for all V and non-empty u. 

Proof Left-to-right: by contraposition, assume that either -<'^ is not E-prefix 
or there exists u and v such that v uv. First case, is not E-prefix. So 
there exists u, v and w such that uv uw and w -<'' v. So the following routing 
problem has no routing equilibrium. 



Second case, there exists u and v such that v uv. The following routing 
problem has no routing equilibrium. 





u 



Target 



The right-to-left implication follows lemma [75l 



□ 
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8 Conclusion 



Consider a collection of labels and a binary relation, called preference, over ul- 
timately periodic sequences over these labels. This chapter shows that if the 
preference is an E-prefix and subcontinuous strict weak order, then all dalo- 
graphs labelled with those labels have equilibria with respect to this preference. 
This sufficient condition is proved by a recursively-defined seeking-forward func- 
tion followed by a proof by induction on the number of arcs in a dalograph. A 
necessary condition is also proved thanks to the notion of simple closure and 
the design of some simple closures, the union of which preserves equilibrium 
existence. Some examples show that the necessary condition is not sufficient in 
general. However, a few examples show the iiscfulness of both the sufficient and 
the necessary conditions. A detailed study shows that the neccessary condition 
plus the subcontinuity plus the transitivity of the incomparability relation im- 
plies the sufficient condition. Because of this, the two conditions coincide when 
the preference is a strict total order, which could also be found by a direct proof. 
However for now, there is no obvious hint saying whether or not the sufficient 
condition is also necessary. 

This chapter applies its theoretical results to a network routing problem: first, 
the above-mentioned sufficient condition yields a sufficient condition on routing 
policy for routing equilibrium existence in a simple routing problem. Second, 
the above-mentioned necessary and sufficient condition of the total order case 
also yields a necessary and sufficient condition on a total order routing policy 
for routing equilibrium existence in a simple routing problem. 

This chapter is also useful to one other respect: many systems that are dif- 
ferent from dalographs also require a notion of preference. In a few of these 
systems, preferences may be thought as total orders without a serious loss of 
generality: in these systems, any preference that guarantees equilibrium exis- 
tence is included in some total order also guaranteeing equilibrium existence, 
and equilibrium existence is preserved by subrelation. In such a setting, consid- 
ering only total orders somehow accounts for all binary relations. However in 
the case of dalographs, there might exist a preference guaranteeing equilibrium 
existence, such that any linear extension of the preference docs not guarantee 
equilibrium existence. In this case, assuming total ordering of the preference 
would yield a (non-recoverable) loss of generality. The following example is a 
candidate for such a preference. Consider the ultimately periodic sequences over 
{a,b,c,d}. An A-transitive preference -< over these sequences is defined below. 

a" -< cU^ -< da'^ 

The preference -< defined above is (A-) transitive and (gen-) E-prefix. In 
addition, it is not included in any transitive and E-prefix total order. Indeed, 
let < be such a total order. If a" < 6'^ then da" < db'^ by E-prcfix and total 
ordering, so cb'^ < ca"^ by transitivity, so b'^ < a" by E-prefix, contradiction. If 
b'^ < a'^ then ca" < cb'^ by transitivity, so a'^ < b" by E-prefix, contradiction. 



40 



So, the key question is whether or not the preference -< guarantees equihbrium 
existence for all dalographs (this is not proved in this chapter). 
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